Minimum Encoding Approaches for Predictive
نویسندگان
چکیده
We analyze diierences between two information-theoretically motivated approaches to statistical inference and model selection: the Minimum Description Length (MDL) principle, and the Minimum Message Length (MML) principle. Based on this analysis, we present two revised versions of MML: a pointwise estimator which gives the MML-optimal single parameter model, and a volumewise estimator which gives the MML-optimal region in the parameter space. Our empirical results suggest that with small data sets, the MDL approach yields more accurate predictions than the MML estimators. The empirical results also demonstrate that the revised MML estimators introduced here perform better than the original MML estimator suggested by Wallace and Freeman.
منابع مشابه
Minimum Encoding Approaches for Predictive Modeling
We analyze differences between two information-theoretically motivated ap proaches to statistical inference and model selection: the Minimum Description Length (MDL) principle, and the Minimum Message Length (MML) principle. Based on this analysis, we present two revised versions of MML: a pointwise estimator which gives the MML-optimal single parameter model, and a volumewise estimator which ...
متن کاملPredictive PID Control of Non-Minimum Phase Systems
Control engineers have been aware of non-minimum phase systems showing either undershoot or time-delay characteristics for some considerable time (Linoya & Altpeter, 1962; Mita & Yoshida, 1981; Vidyasagar, 1986; Waller & Nygardas, 1975). A number of researchers that addressed this problem from a predictive control point of view mainly followed one of two approaches: a classical (non-optimal) pr...
متن کاملPlausible Prediction by Bayesian Inference
The capability to perform inference with uncertain and incomplete information is characteristic to intelligent systems. Many of the research issues in artiicial intelligence and computational intelligence can actually be viewed as topics in the \science of uncertainty," which addresses the problem of plausible inference, i.e., optimal processing of incomplete information. The various diierent a...
متن کاملA Comparison of Encodings and Algorithms for Multiobjective Minimum Spanning Tree Problems
Finding minimum-weight spanning trees (MST) in graphs is a classic problem in operations research with important applications in network design. The basic MST problem can be solved eeciently, but the degree constrained and multiobjective versions are NP-hard. Current approaches to the degree-constrained single objective MST include Raidl's evolutionary algorithm (EA) which employs a direct tree...
متن کاملDetecting Selection in DNA Sequences: Bayesian Modelling and Inference
Recent developments in Bayesian modelling of DNA sequence data for detecting natural selection at the amino acid level are presented. This article summarizes and discusses empirical model-based approaches. Key features of the modelling framework include the incorporation of biologically meaningful information via structured priors, posterior detection of sites under selection, and model validat...
متن کامل